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Abstract 

We  provide  sufficient  conditions  for  the  existence  of  a  solution  to  a  consumption  and  portfolio 
problem  in  continuous  time  under  uncertainty  with  an  infinite  horizon.  \N'hen  the  price  processes 
for  securities  are  diffusion  processes,  optimal  policies  can  be  computed  by  solving  a  linear  partial 
differential  equation.  We  also  provide  conditions  under  which  the  solution  to  an  infinite  horizon 
problem  is  the  limit  of  the  solutions  to  finite  horizon  problems  when  the  horizon  increases  to 
infinity. 


'The  authors  would  like  to  thank  conversations  with  Robert  Merton. 
'Sloan  School  of  Management,  Massachusetts  Institute  of  Technology 
'Bank  of  France,  Centre  de  recherche 


1     Introduction  and  Summary  1 

1     Introduction  and  Summary 

Recent  advances  in  the  understanding  of  dynamic  asset  markets  have  made  available  a  set  of  new 
tools  to  analyze  the  optimal  consumption  and  portfolio  decision  of  an  individual  in  continuous  time 
under  uncertainty;  see  Cox  and  Huang  ( 1989,  1990),  Karatzas,  Lehoczky,  and  Shreve  ( 1987),  He  and 
Pearson  (1989),  Pages  (1988),  and  Pliska  (1986).  There  are  several  attractive  features  of  these  new 
tools.  First,  the  existence  problem  of  an  optimal  consumption  and  portfolio  policy  for  an  individual 
can  be  analyzed  with  much  ease  while  the  admissible  policies  do  not  take  their  values  in  a  compact 
set  and  the  consumption  must  obey  a  positive  constraint.  Second,  when  securities  prices  follow 
a  diffusion  process,  the  optimal  policies  can  be  computed  by  solving  a  linear  partial  differential 
equation  in  contrast  to  a  highly  nonlinear  Bellman  equation  in  dynamic  programming.  Third,  in 
some  situations,  optimal  policies  can  even  be  computed  directly  by  evaluating  some  integrals. 

The  aforementioned  papers,  however,  address  the  optimal  consumption  and  portfolio  problem  in 
economies  with  a  finite  horizon.  The  purpose  of  this  paper  is  to  show  how  this  set  of  new  tools  can 
be  brought  to  bear  on  the  same  problem  in  economies  with  an  infinite  horizon.  Our  conclusions  are 
that,  except  for  some  important  technical  departures,  the  existence  and  computation  of  an  optimal 
policy  can  be  analyzed  similarly  with  the  same  attractive  features  as  in  finite  horizon  economies. 

We  also  study  the  convergence  of  optimal  policies  in  finite  horizon  economies  to  those  in  infinite 
horizon  economies.  We  show  that  pointwise  convergence  always  occurs  for  optimal  consumption 
policies.  In  general,  however,  portfolio  policies  converge  only  in  a  certain  norm  involving  taking 
expectations.  On  the  other  hand,  if  the  optimal  portfolio  policies  for  finite  horizon  economies  do 
converge  at  all  pointwise,  they  must  converge  to  the  optimal  policy  in  the  infinite  horizon  economy. 
Note  that  this  type  of  convergence  result  is  very  difficult  to  get  by  using  dynamic  programming. 

The  analysis  in  this  paper  utilizes  Cox  and  Huang  (1989,  1990)  extensively,  which  the  reader  may 
want  to  consult.  Two  other  papers  complement  our  study.  First,  Merton  (1989)  uses  the  Cox-Huang 
technique  to  solve,  in  infinite  horizon,  the  optimal  consumption  and  portfolio  policy  in  closed-form 
for  a  class  utility  functions  when  asset  prices  follow  a  geometric  Brownian  motion.  Second,  Foldes 
(1989),  using  a  different  but  related  technique,  also  analyzes  the  optimal  consumption  and  portfolio 
problem  with  an  infinite  horizon  in  a  stochastic  environment  more  general  than  ours.  He  however, 
does  not  give  explicit  conditions  for  existence  nor  does  he  study  convergence  properties  of  optimal 
policies. 

The  rest  of  this  paper  is  organized  as  follows.  Section  2  formulates  the  model.  The  existence 
and  computation  of  optimal  policies  are  ancilyzed  in  Section  3  and  Section  4,  respectively.  Section  6 
gives  results  on  convergence  and  Section  7  contcuns  concluding  remarks. 
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2     Formulation 

We  consider  a  securities  market  under  uncertainty  in  continuous  time  with  an  infinite  horizon.  We 
will  use  an  .V-dimensional  Brownian  motion  to  model  the  evolution  of  exogenous  uncertainty.  Thus 
we  take  the  "state  space"  fi  to  be  the  space  of  continuous  functions  from  [0,oo)  to  3?^  equipped 
with  the  topology  of  uniform  convergence  on  compact  subintervaJs  of  [0,oo).'  The  collection  of 
distinguishable  events  is  the  Borel  sigma-field  of  fi  denoted  by  T  and  the  probability  belief  of 
the  agent  to  be  considered  is  the  W/ener  measure  on  {^,T)  denoted  by  P.  It  is  well-known  that 
under  P  the  coordinate  process 

w(u;,t)  =  uj{t),      Vu;  e  fi, 

is  an  A'-dimensional  standard  Brownian  motion^,  where  u){t)  is  the  value  at  time  t  of  the  JJ^-valued 
continuous  function  u  E.  Q.  Since  a  state  of  nature  is  a  complete  realization  of  iv  on  the  time  interval 
[0,  oo)  and  one  learns  the  true  state  of  nature  by  observing  w  over  time,  we  model  the  intertemporal 
resolution  of  uncertainty  by  an  increasing  and  right-continuous  family  of  sub-sigma-field  of  .?"  or  a 
filtration  F  =  {J^t'J  £  ^-t-})  where  Tt  =  D^-^t^t  ^"d  J^°  is  the  smadlest  sigma-field  generated  by 
{u;(5);0  <  5  <  t}.^  One  can  verify  that  7^  =  \/t>o^ty  that  is.  all  the  distinguishable  events  are 
generated  by  sample  paths  of  w.  As  a  standara  Brownian  motion  starts  from  zero  at  time  t  —  0 
with  probability  one,  J^q  contains  only  subsets  of  T  that  are  probability  one  or  zero. 

A  process  A'  is  a  mapping  from  fi  x  3?+  to  5?  that  is  measurable  with  respect  to  7"  x  B(Ji+), 
the  product  sigma-field  oi  T  and  B{'^^).  A  process  X  is  adapted  (to  F)  li  X{t)  is  measurable  with 
respect  to  J^f  A  process  A'  is  predictable  if  it  is  P-measurable,  where  V  is  the  field  on  fi  x  Ji+ 
generated  by  all  left-continuous  adapted  processes.  A  process  A'  is  progressively  measurable  or 
simply  progressive  if  the  restriction  of  X  to  f2  x  [0,t]  is  measurable  with  respect  to  J^t  x  5([0,<])  for 
all  t  £  3?+.  A  process  X  is  adapted  (to  F)  \{ X{t)  is  measurable  with  respect  to  !Ff  Obviously,  A'  is 
adapted  if  it  is  progressive.  The  converse  is  not  necessarily  true  in  general  but  is  true  in  our  setup; 
see  Stroock  and  Varadhan  (1979,  Exercise  1.5.6).  A  martingale  X  under  P  here  is  a  progressive 
process  that  has  right-continuous  paths  and  has  continuous  path  with  P  probability  one  so  that 
E[X{s)\J^t]  =  X{t)  P-a.s.  for  all  s  >  t,  where  jE[-|.?^(]  is  the  expectation  under  P  conditional  on 
Tf.  For  any  integrable  random  variable  Y  on  {il,J^,P),  there  exists  a  (P)  martingale  X  so  that 
X{t)  =  £'[y|.F(]  P-a.s.;  see  Jacod  and  Shiryayev  (1987,  remark  1.37).  All  the  processes  to  appear 
will  be  adapted  and  therefore  progressive,  and  all  the  conditional  expectations  to  appear  will  be 


'See  Williams  (1979,  p.20). 

'a  Btandard  Brownian  motion  is  a  Brownian  motion  that  starts  at  zero  with  probability  one. 
'Throughout  this  paper  we  will  use  weak  relations.    For  example,  positive  means  nonnegative,  increasing  means 
nondecreasing,  etc. 
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martingales. 

Remark  1  In  the  above  setup,  the  probability  space  (ft,  J",  P)  is  not  complete*  and  the  filtration  F 
does  not  satisfy  the  usua.1  conditions^.  This  is  a  departure  from  the  earlier  literature  such  as  Cox 
and  Huang  (1989,  1990).  This  departure  is  important  for  our  purpose;  otherwise.  Proposition  1  to 
follow  is  not  valid. 

We  will  use  the  following  notation:  if  x  is  a  matrix,  then  \x\  =  ( trace(ix  )  1  ,  where  denotes 
"transpose." 

There  are  A^  +  1  securities  traded  continuously  on  the  infinite  time  horizon  [0,3o)  indexed  by 
n  =  0, 1,2, . . . ,  A'.  Security  n  7^  0  is  risky  and  is  represented  by  a  process  of  right-continuous  and 
bounded  variation  sample  paths  D^  with  Dn{t)  representing  cumulative  dividends  paid  by  security 
n  from  time  0  to  time  t.  Denote  the  ex-dividend  price  of  security  n  /  0  at  time  t  by  S„(0  and 
let  S{t)  =  (Si{t),...,S!^{t)y  and  D{t)  =  {Di{t), . . . ,  D^it)y .  .A.s  these  securities  are  traded 
ex-dividends,  assume  without  loss  of  generality  that  Dn{0)  =  0  for  all  n  =  1,2, . . .  ,.V.  We  assume 
also  that  S  +  D  is  an  N-vector  process: 

S{t)  +  D{t)  =  S'(})+   I  b(s,u)ds+   I  ais,Lj)dw{s),      t  e  Pi+.  (1) 

Jo  Jo 

where  6  and  a,  respectively,  are  A^- vector  and  N  x  A'-matrix  processes  satisfying 

rt 


I 


f  \b{s)\ds     <     oc,     P-a.s.,Wt>0,  (2) 

a(s)\'^ds     <     00,      P-  a.s.^Wt  >0,  (3) 

0 

6 


and  the  second  integral  of  (1)  is  a  stochastic  integral. 

We  assume  that  a(t)  is  a.s.  of  full  rank  for  all  t.  The  zero-th  security,  called  the  bond,  is  locally 
riskless.  Its  price  at  time  t,  B{t),  is  expl/^  r{s)ds}.  One  can  view  this  security  as  a  bank  account 
that  pays  an  instantaneous  interest  rate  r{t)  at  time  t.  For  B  to  be  well-defined,  we  assume  that 
the  interest  rate  process  r  satisfies 

rt 
\r{s)\ds<  00,     P-a.s.,Wt>0.  (4) 


i 


*A  probability  space  {Q,T,  P)  is  complete  if  any  subset  of  a  probability  zero  set  is  an  element  of  T. 

*A  filtration  F  satisfies  the  usua/  conditions  if  (i)  it  is  right-continuous:  ^t  =  ^ix^m  for  all  t  6  3?+;  (ii)  it  is 
complete:  Tq  contains  all  the  P-measure  zero  sets. 

*The  usual  definition  of  a  stochastic  integral  depends  on  the  completion  of  a  probability  space  and  a  filtration 
satisfying  the  usual  conditions;  see,  for  example,  Liptser  and  Shiryayev  (1977,  chapter  4).  The  definition  of  a  stochastic 
integral  here  is  based  on  Jacod  and  Shiryaev  (1987,  chapter  1)  and  has  all  the  usual  properties.  In  particular,  the 
stochastic  integral  of  a  continuous  local  martingale  is  a  continuous  local  martingale  and  Ito's  formula  is  vaJid,  where 
we  recall  that  a  process  A'  is  a  local  martingale  under  P  if  there  exists  a  sequence  of  optional  times  T„  ]  cxj,  P-a.s., 
so  that  the  process  {X{Tn  A  t);  t  g  3?+ )  is  a  (uniformly  integrable)  martingale  for  all  r„. 
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Now  consider  an  agent  with  a  time-additive  utility  function  for  consumption,  u{c,t)  and  an 
initial  wealth  Wq  >  0.  Assume  throughout  that  u(c,  <)  is  continuous  in  (c,t),  concave  and  increasing 
in  c,  and  is  possibly  unbounded  from  below  at  c  =  0.  This  agent  wants  to  manage  a  portfolio  of  the 
risky  securities  and  the  bond,  and  withdraw  funds  out  of  the  portfolio  to  maximize  his  expected 
utility  of  consumption  over  time.  Our  task  here  is  to  find  conditions  on  the  utility  function  and  on 
the  price  processes  to  guarantee  the  existence  of  a  solution  to  the  agent's  problem. 

We  refer  to  the  price  system  as  the  A'^-vector  of  normalized  prices  defined  by  S'{t)  =  S{t)/B{t). 
Ito's  formula  implies  that 

The  process  on  the  left-hand  side  is  called  the  gains  process  and  here  it  is  expressed  in  units  of  the 

bond.  Putting 

G{t)  =  S'{t)+  f-±-dDis), 
Jo   B(s) 

one  sees  that  the  difference  G(t)  -  5(0)  represents  the  accumulated  capital  gains  and  accumulated 

dividends  on  risky  assets  in  units  of  the  bond,  where  we  note  that  since  5(0)  =  1,  S''(0)  =  5(0). 

A  trading  strategy  is  a  A^  +  1-vector  process  (q,^^)  =  (q,  (^' , . . .  ,0^)),  where  a{t)  and  ^"(<) 

are  the  number  of  shares  of  the  bond  and  of  risky  asset  n,  respectively,  owned  by  the  investor  at 

time  t  before  trading.    The  investor's  wealth  in  units  of  the  bond  at  time  t  after  the  receipt  of 

dividends  is 

W{t)  =  ait)  +  0{ty{S'{t)  +  A£)(0/5(0). 

For  now,  a  consumption  plan  c  is  an  adapted  process  that  is  positive  (except  on  a  set  that  is 
negligible  with  respect  to  the  product  measure  generated  by  P  and  Lebesgue  measure  on  Ji+)  with 
c(t)  denoting  the  consumption  rate  at  time  t.  A  trading  strategy  is  said  to  finance  the  consumption 
plan  c  if  the  following  intertemporal  budget  constraint  holds: 


Jo    ij[S)  Jo 


(5) 


provided  that  the  stochastic  integral  on  the  right-hand  side  is  well-defined.  This  equation  says 
that,  in  units  of  the  bond,  the  value  of  the  portfolio  at  time  t  is  equal  to  its  initial  value  plus 
accumulated  capitaJ  gains  or  losses  and  minus  accumulated  withdrawals  for  consumption.  For  the 
stochjistic  integral  of  (5)  to  be  well-defined,  we  introduce  the  class  C{G)  of  trading  strategies  (a,  9), 
the  6  of  which  satisfies 

ds  <  oo,         P  -  a.s., 


I 


0 


e{s)''a{s)  ' 


B{s) 
for  a  sequence  of  optional  times  T„  ]  oo,  P-a.s. 
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For  the  agent's  problem  to  be  well-posed,  however,  it  is  necessary  that  something  cannot  be 
created  from  nothing  through  trading  using  reasonable  trading  strategies.  This  is  the  subject  to 
which  we  now  turn. 

Up  to  now  nothing  was  said  about  the  existence  of  arbitrage  opportunities.  In  fact  with  the 
strategies  we  have  defined  it  is  well  known  that  such  arbitrage  opportunities  do  exist,  even  in  finite 
time;  see  the  doubling  strategy  of  Harrison  and  Kreps  (1979).  Were  this  the  case,  the  consumption 
and  portfolio  choice  problem  would  not  be  well-posed.  To  rule  out  arbitrage  opportunities,  we  will 
impose  a  regularity  conditions  on  the  parameters  of  the  price  system  and  a  natural  institutional 
constraint  that  wealth  cannot  be  strictly  negative.  This  constraint  has  been  analyzed  by  Dybvig 
and  Huang  (1989)  and  Harrison  and  Pliska  (1981). 

We  make  the  following  assumption  throughout  our  analysis: 

Assumption  1   Let  K{t)  =  —<7{t)~^(b{t)  -  r{t)S{t)).   There  exists  a  positive  constant  K  <  oo  such 
that  \K{u,t)\  <  K  for  all  t,  P-a.s. 

This  assumption  is  in  particular  satisfied  in  the  models  originally  considered  by  Samuelson 
(1965)  and  Merton  (1971).  Now  define  a  martingale  under  P  that  is  almost  surely  strictly  positive: 

i{t)  =  ex^^j\{sYdw{s)-^j^  \K{s)\^dsY     «e^V- 
By  Assumption  1,  it  is  easily  verified  that  £[^(<)]  =  1.  Thus 

Qt{A)=   f  a^,t)P{du)    'iAeJ't, 

JA 
is  a  probability  measure  equivalent  to  P.   The  family  of  probability  measures  {Qt\t  6  [0,oo)}  is 
"consistent"  in  that  Q,  equals  Qt  on  Tt,  where  oo  >  s  >  <  >  0.  We  have  the  following  result. 

Proposition  1    There  exists  a  probability  Q  on  {^,T)  such  that  its  restriction  on  JT,  is  equivalent 
to  the  restriction  of  P  on  Tt  for  all  t  G  3?+-  Moreover,  under  Q, 

Git)  =  5(0)  +  /'  1^  dw'is),     t  e  [0,  oo), 

Jo    Jt>{S) 

and  thus  is  a  local  martingale^  under  Q,  where  w'{t)  =  w{t)  -  Jq  K{s)ds  is  an  N -dimensional 
standard  Brownian  motion  under  Q. 

Proof.     Define  a  consistent  family  Qt  on  {0.,Tt)  as  above.  Stroock  (1987,  lemma  4.2)  shows  that 
there  exists  a  unique  Q  on  (n,.F)  so  that  Q\J^t  =  Qt  for  all  <  G  3f+.  Since  Q  is  equivalent  to  P  on 


^See  footnote  6  for  a  definition 
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Ti^  we  have  the  first  assertion.  The  second  assertion  follows  from  the  definition  of  k  and  Girsanov's 
theorem  (see,  e.g.,  Stroock  (1987,  lemma  4.3)).      I 

Since  P  and  Q  are  equivalent  on  (Q,^()  for  any  finite  <,  they  are  said  to  be  locally  equivalent. 
On  the  other  hand,  P  and  Q  may  disagree  on  the  cr-field  .F,  as  shown  in  the  following  lemma. 

Lemma  1    The  measures  Q  and  P  are  mutually  singular  if  and  only  if  J^  \K{t)\^  dt  =  oo,  Q-a.s. 

Proof.  By  the  Radon-Nikodym  theorem,  there  exists  a  extended-valued  random  variable  ^^ 
such  that  P{^oo  =  oo)  =  0  and 

Q{A)  =  E[UlA]  +  Q{An{^=oc}),     VA6^; 

see,  e.g.,  Jacod  (1979,  theorem  7.1).  For  P  and  Q  to  be  mutually  singular,  it  is  necessary  and 
sufficient  that  Q{^oo  <  oo)  =  0.  But  theorem  8.19  of  Jacod  [1979]  shows  that  in  fact 

{foo<oc}  =  i    /     \K{t)\'^  dt  <  oo  \  ,     Q-a.s., 

and  so  P  and  Q  are  mutually  singular  if  and  only  if  J^  \K{t)\'^  dt  =  oc,  Q-a.s.,  as  desired.       I 

In  the  models  of  Samuelson  or  Merton,  the  process  k  is  constant,  so  by  the  lemma  above  P  and  Q 
are  mutually  singular.  The  almost  surely  statements  on  J^  can  no  longer  be  applied  indifferently 
with  respect  to  either  probability,  as  they  can  be  in  the  finite  horizon  case.  However,  one  can  still 
use  a/most  surely  with  respect  to  both  P  and  Q  in  restriction  to  J^t^  for  all  t  £  J?^.. 

Lemma  2  Suppose  {oi,0)  6  C{G).  Then  the  integml  /^  ^(s)^(fG(5)  is  an  ltd  process  under  both  P 
and  Q  and  is  the  same  whether  it  is  computed  relative  to  (F,P)  or  to  (F,Q). 

Proof.     From  the  definition  of  G  one  has 

Pm  ^T.r,  ,        f\.  ,rb{s)-r{s)Sis)  ^         f^e{sVa(s) 

/    ^(s)   dG(s)=   /    9{s)    — ds+  /    — -——dw{s). 

Jo  Jo  B{s)  J  3        B(s) 

Since  (q,^)  €  C{G),  the  stochastic  integral  on  the  right  hand  side  is  well  defined  under  P.  On  the 
other  hand  by  Assumption  1,  there  exists  A'  <  oo  such  that  \k\  <  K .  By  the  definition  of  k,  we 
have  thus 


^(0 


jb{t)-r{t)S{t) 


Bit) 


9it) 


a{t)K{t) 


and  so 


^(0 


jb{t)-r(t)S(t) 
B{t) 


Bit) 


<  K 


eit)^ait] 


Bit) 


Kit) 


0(t)^<^it] 
Bit) 
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Thus  the  Lebesgue  integral  is  finite,  and  /q  9{s)''^dG{s)  is  an  Ito  process  under  P.  The  rest  of  the 
assertion  follows  from  Stroock  (1987,  III. 4. 3).      I 

We  are  ready  to  show  that  there  are  no  arbitrage  opportunities  when  the  positive  wealth  con- 
straint is  in  force.  Our  proof  is  a  direct  generalization  of  Dybvig  and  Huang  (1989,  theorem  2).  We 
first  recall  the  following  usual  definition  of  an  arbitrage  opportunity. 

Definition  1   An  arbitrage  opportunity  is  a  strategy  (a, 6)  €  C{G)  with  U^(0)  =  0  that  finances  a 
consumption  plan  c  that  is  positive  and  nonzero. 

We  need  a  technical  lemma  to  proceed: 


Lemma  3   Let  c  be  a  consumption  plan.   Then 


E' 


if 

.Jo 


c(0 


B{t) 


dt 


[f 

.Jo 


B{t) 


dt 


where  E'  denotes  expectation  under  Q. 


Proof.     For  any  finite  t. 


E' 


j: 


cjs) 
Bis) 


ds 


=  E 


i: 


c{s)as) 

B{s) 


ds 


see  Dellacherie  and  Meyer  (1982,  VT.57).  Given  that  P  and  Q  are  locally  equivalent,  c  is  positive 
on  any  finite  subinterval  of  [0,oo)  under  either  P  and  Q.  Thus  the  integrands  on  both  sides  of 
the  above  relation  are  positive  and  increase  in  t.  Thus  letting  <  — ►  cx),  by  monotone  convergence 
theorem  we  have  the  assertion.      I 


Proposition  2  Let  c  be  a  consumption  plan  financed  by  (a,  6)  £  C(G)  with  W{0)  =  0  and  with 
W{t)  >  0,  P-a.s.  for  all  t  G  3?+.    Then  P-almost  surely,  c  is  identically  zero. 

Proof.     From  (5)  we  have 

r  44  (^^ + ^(0 = ^(0)  +  r  e{tfdG{t),  vi  €  3?+. 

JO   B{s)  Jo 

By  Proposition  1  and  the  fact  that  {a,0)  G  C(G),  the  right-hand  side  of  the  above  relation  is 
a  positive  local  martingale  under  Q  since  by  the  positive  wealth  constraint  the  left-hand  side  is 
positive.  It  is  known  that  a  positive  local  martingale  is  a  supermartingale;  see,  e.g.,  lemma  1  of 
Dybvig  and  Huang  (1989). 
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By  the  fact  that  c  is  a  positive  process  under  P  and  P  and  Q  are  locally  equivadent,  we  know 
c  is  a  positive  process  under  Q  on  any  finite  subinterval  [0,(].  This  implies  that 


E' 


f 

Jo 


c{t) 
B(t) 


dt 


(-~       [Jo  B(s} 
<     Mm  E'     f 


c{s) 
B{s) 


ds  +  W(t) 


<     W{0)  =  0, 


where  E'[-]  is  the  expectation  under  Q,  the  first  equality  follows  from  the  monotone  convergence 
theorem,  the  first  inequality  follows  from  the  fact  that  \V(t)  >  0,  P-a.s.  and  thus  Q-sl.s.  since  P 
and  Q  are  locally  equivalent,  and  the  second  inequality  follows  from  the  above  mentioned  super- 
martingale  property.  Lemma  3  then  implies  that 

ccm) 


f 

Jo 


Bit) 


dt 


<  0. 


Since  ^  is  a  strictly  positive  process  under  P,  it  must  be  the  case  that  c  is  identically  zero  P-almost 
surely.      I 

Thus  trading  strategies  from  C{G)  that  satisfy  the  positive  wccilth  constraint  cannot  be  arbitrage 
opportunities. 

In  models  of  a  finite  horizon  T  such  as  Cox  and  Huang  (1989,  1990),  a  consumption  plan  c  is 
admissible  if 


Jo 


tWdt 


<  CO 


for  some  given  p  E  [1,cxd).  A  direct  generalization  of  this  space  to  our  setup  by  taking  T  =  oo  is 
unsatisfactory  since  it  does  not  include  consumption  plans  that  do  not  go  to  zero  as  time  approaches 
infinity,  which  we  do  not  want  to  rule  out  a  priori.  We  will  let  the  space  of  admissible  consumption 
plans  depends  upon  the  impatience  of  the  agent. 

We  assume  that  the  utility  function  of  the  agent  satisfies  the  following  additional  condition. 


Assumption  2  For  all  a  >  Q,  t  <  s,  then  u{a,t)  >  u{a,s), 

/•oo 

/      \u{a,t)\dt  <oo,  (6) 

Jo 

and  there  exists  Ka  >  0  such  that 

Ua+{a,t)<K^\u{a,t)\,      a.e.  <  G  ??+,  (7) 

where  Ua^(a,t)  denotes  the  right-hand  partial  derivative  ofu{a,t)  with  respect  to  its  first  argument.^ 


'Right-hand  derivatives  of  a  concave  function  always  exist. 
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Note  that  the  first  hypothesis  of  Assumption  2  implies  impatience,  while  relation  (6)  requires 
that  impatience  to  be  sufficiently  strong.  Relation  (7)  will  later  be  used  to  show  that  the  space  of 
admissible  consumption  plans  to  be  specified  is  invariant  with  respect  to  the  choices  of  a  among 
those  a's  so  that  u{a,t)  >  0  for  all  t. 

Remark  2   If  u{c,t)  =  t;(c)e~*''  with  St  >  0  for  all  t  >  0,  then  it  satisfies  Assumption  2. 

Pick  some  a  >  0  and  define  a  finite  measure  by 

K{A)=   I  \u{a,t)\dt,     V/lGS(R+), 
Ja 

and  denote  the  product  measure  generated  by  P  and  A^,  by  Ua-    Note  that  A^  is  equivalent  to 

Lebesgue  measure  since  by  impatience  |u(a,<)|  >  0  except  possibly  for  one  t.  Fix  p  £  [l,oc).  We 

will  say  that  a  consumption  plan  c  is  admissible  if 

E     /      \c{t)\^\u{a,t)\dt    <  oo. 
Jo 

Then  the  space  of  admissible  consumption  plans  is  the  positive  orthant  of  the  space  L^{ua)  = 

ZP(fi  X  3?-|.,PA1,^'a),  where  VM  denotes  the  progressive  sigma-field.^  We  will  denote  the  positive 

orthant  of  L^{ya)  by  L\{i'a)- 

The  following  lemma  shows  that  the  space  of  admissible  consumption  plans  is  invariant  with 

respect  to  choices  of  a  >  0. 


Lemma  4  For  any  strictly  positive  scalars,  a  and  a'  such  that  u{a,t)  >  0  and  u{a',t)  >  0  for  all 
t,Ll{ua)  =  Ll(i^a'). 

Proof.     Let  c  G  L'^lua).  We  can  write 

E     /      \cit)\''\u{a',t)\dt    <E     /      \c{t)\P\u{a,t)\dt    +E     /      \c(t)\P\u{a' ,t)  -  u{a,t)\dt    . 
Jo  J  L-'o  J  L^o 

The  first  term  on  the  right-hand  side  of  the  inequality  is  finite  by  assumption.  If  we  can  show  that 

the  second  term  is  finite,  then  c  6  i^(i'a').  Assume  first  that  a'  >  a.  We  have 

/■oo  1  r   /-oo 

/      \c{t)\''\uia',t)-u{a,t)\dt       <     E     /      \c{t)\^Ua+{a,t){a'  -  a)  dt 
Jo  J  Uo 


<     {a'-a)E 


yoo 

/      \c{t)\n<M{a,t)\dt 
Jo 


<  oc, 


'a  set  X  G  O  X  3?+  is  a  progressive  set  if  1^(0;,  <)  is  a  progressive  process.  The  progressive  sigma-field  is  the 
sigma-field  generated  by  all  the  progressive  sets.  A  process  is  a  progressive  process  if  and  only  if  it  is  measurable 
with  respect  to  the  progressive  sigma-field.  Thus  any  element  of  i''(i'a)  is  a  progressive  process  and  thus  adapted. 
Conversely,  any  adapted  process  satisfying  the  L''  integrability  condition  with  respect  to  fa  is  an  element  of  L''(i'a) 
since  in  our  setup  any  adapted  process  is  progressive.  A  good  reference  for  the  discussion  above  is  Slroock  and 
Varadhan  (1979,  exercise  1.5.6  and  1.5.11). 
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where  the  first  inequality  follows  from  the  concavity  of  u  and  the  second  inequality  follows  from  (7). 
Next  suppose  that  a'  <  a.   Arguments  identical  to  those  above  prove  the  assertion  by  noting 
that 

\u{a\t)  -  u{a,t)\  <  u+(a',t)(a  -  a')  <  Kau{a',t)(a  -  a')  <  Kau{a,t){a  -  a). 

Similar  arguments  prove  that  c  €  L^{Ua')  implies  c  6  L''(i/a)-      I 

Now  we  are  ready  to  specify  completely  the  agent's  problem.  He  wants  to  solve  the  following 

program: 

sup(a.e)eAG)      E[f^  u{c(t),t)dt] 

W(1)>0 

s.t.    W{0)  =  a{0)BiO)  +  e{OfS{0)<Wo,  rg\ 

c  is  financed  by  (a,0) 
and  c  €  L^{i^a)- 

We  will  say  that  there  exists  a  solution  to  the  program  (8)  if  the  value  of  the  program,  val{\Vo), 

is  finite  and  is  attained  by  a  consumption  plan  financed  by  an  admissible  trading  strategy  that 

satisfies  the  positive  wealth  constraint. 

3     Existence  of  An  Optimal  Policy 

We  provide  in  this  section  sufficient  conditions  for  the  existence  of  a  solution  to  (S).  Our  technique 
follows  Cox  and  Huang  (1990).  We  first  transform  the  dynamic  majdmization  problem  into  a  static 
variational  problem  whose  solution  is  well-understood.  The  solution  of  the  static  problem  is  then 
implemented  with  a  dynamic  trading  strategy  uncovered  by  a  martingale  representation  theorem. 
Consider  the  following  static  variational  problem: 

suPc6L^^(..)     E[!^u{c{t),t)dt] 


s.t.    E 


TOO    C{t)({t)      ,.       ^    Txr 

Jo        Bit)     ^''     -   ^^'^O 


m 

We  first  show  that  the  dynamic  program  (8)  is  equivalent  to  the  static  variational  program 
of  (9). 

Proposition  3  c  is  a  feasible  consumption  plan  in  (8)  if  and  only  if  it  is  one  in  (9). 

Proof.     Let  c  G  L\{i^a)  be  financed  by  (a,&)  G  C{G)  satisfying  the  positive  wealth  constraint 
and  with  1^(0)  <  H^o-  From  the  proof  of  Proposition  2  we  know  that 

f  ^,ds'rW(t)  =  W{Q)+  f  6{tfdG[t),         Vi>0,      P  -  a.s. 

Jo     i3[S)  Jo 
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is  a  supermartingale  under  Q.  Thus 

r'  c{s) 


E' 


^0     -0(5)  J 


Because  W[t)  >  0  and  c{t)  >  0  under  P,  by  the  local  equivalence  of  P  and  Q,  we  know 


E' 


B{s) 


I 


ds 


<w{0)   v<e3?+, 


and 


.Jo 


cjt) 
B{t) 


dt 


<  W{0), 


where  the  monotone  convergence  theorem  is  used  for  the  second  inequality.   It  then  follows  from 
Lemma  3  that 

Thus  c  is  feasible  in  (9). 


.-'0 


B{t) 


dt 


<  W{0)  <  Wq. 


Conversely,  let  c  G  X^(fo)  be  feasible  in  (9).  Lemma  3  implies  that 


''[Jo     B 


(0 
^(0 


dt 


<  Wo. 


Thus 


Since  all  P-local  martingales  have  the  representation  property  relative  to  w  (see  Jacod  and  Shiryaev, 

theorem  III. 4. 33),  and  since  Q  and  P  are  locally  equivalent,  all  Q-local  martingales  also  have  the 

representation  property  relative  to  w'  (op.  cit.,  theorem  III. 5. 24).  Hence  there  exists  an  A'-vector 

process  p  with 

/       \p{s)\  ds  <  oo         r„  t  oo,      Q  -  a.s., 
Jo 

such  that 


E' 


f 

Jo 


c{s) 


ds\Tt 


B{s) 
Let  e{ty  =  B{t)p{tya{t)-\ 


=  E' 


r4r-M+  fpi^fdw'is)    ter,+,  Q-a.s. 

.Jo     ti{s)     J       Jo 


W{t)  =  E'   J 


B{s) 

cjs) 
Bis) 


dslJ't 


>  0     Wt  P  -  a.s.. 


(10) 


and 


a(t)  =  W{t)  -  e{t)^{S'{t)  +  AD{t)/B{t)). 

Since  c  >  0  under  P,  W{t)  >  0,  Q  and  P-a.s.  Let  T  =  lim  T  ^n-  Since  Q  and  P  are  equivalent  in 
restriction  to  {T  <  oo}  (Jacod  and  Shiryaev,  theorem  III. 3. 4),  P{T  <  oo)  =  P(^{T)lf^j^^j)  -  0, 
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and  so  Tn  ]  oc,  P-a.s.   Hence  {a, 9)  £  C{G).  Also  by  construction  and  the  locai  equivalence  of  P 
and  Q  we  have 

W^(0  +   /'  ^.ds  =  q(0)  +  ^(0^5(0)  +  /'  eisfdGis),     Q  -  a.s.,  P  -  a.s.,  te^+. 
Jo    rl(Sj  Jo 

That  is,  (q,^)  finances  c.  Finally,  it  is  easily  seen  that  W{0)  <  Wq.  Thus  c  is  feasible  in  (8).      I 

We  record  an  immediate  corollary  of  Proposition  3. 

Corollary  1  c  is  a  solution  to  (8)  if  and  only  if  it  is  a  solution  to  (9). 

Given  this  corollary  we  can  then  concentrate  on  (9).  Note  that  since  (8)  and  (9)  are  equivalent, 
we  will  also  use  val  [Wq]  to  denote  the  value  of  (9). 

We  first  provide  conditions  under  which  val  [Wq)  is  finite. 

Proposition  4  Suppose  that 

1.  for  almost  all  t,  u{c,t)  is  unbounded  from  above  in  c  and  there  exists  /3i  >  0,  /32  >  0  and 
6  €  (0, 1)  such  that  for  some  a  >  0, 

uic,t)<\u(a,t)\{3,  +  ^^ic'-'-l)),      a.e.t-  (11) 

and 

{aB)-'\u{a,t)\eL^I\u,).  (12) 

2.  and  that,  if  u{c,t)  is  unbounded  from  below  at  the  origin  on  a  set  A  oft  with  strictly  positive 
Lebesgue  measure, 


L 


Bit) 


-dt 


<  oo.  (13) 


Then  Da/(VVo)  is  finite. 


Proof.  We  first  show  that  val{WQ)  <  oo.  When  the  utility  function  is  \u{a,t)\{Pi  + ^hi'^^''' ~'^)) 
with  6  G  (0, 1),  there  exists  a  solution  c  to  (9)  only  if  there  exists  7  >  0  so  that 

Relation  (12)  ensures  that  c  G  I^(i/o)-  For  c  to  actually  be  a  solution,  it  must  also  satisfy  the 
budget  constraint  and  yield  a  finite  expected  utility.  For  the  former  it  is  necessary  and  sufficient 
that 

c(()«i) 


Jo 


^,  .     dt 
B{t) 


<  00, 


3     Existence  of  An  Optimal  Policy 


13 


for  then  7  can  be  chosen  to  exhaust  the  initial  wealth.  Putting  p  =  p/(l  -b)  >  p  and  l/p+  l/q  =  1, 
Holder's  inequjility  implies 

cimt) 


1— - 

1^)      '  \u{a,t)\-'^l  dUt) 


_i 
7  \    b 


P2 


r  (^] 

Jo     \B(t)J 


\u{a,t)\'' d\^{t) 


\u[aj)\dt        <  oc, 


where  the  last  inequality  follows  (12)  and  Assumption  2.  Finally,  we  have  to  verify  that  the  expected 
utility  is  finite.  For  this  we  note  that 


r  city-^\uia,t)\dt\   =  ^L^ir^ADhL 

Jo  '        I    ^    '   ^1      J  /?2  ^  [Jo         B{t] 


dt 


<     ^U'o  <  00. 

Thus  val{Wo)  <  00  by  (11). 

Next  we  take  two  cases.  Suppose  first  that  u{c,t)  is  bounded  from  below  for  a.e.  '  Then 
val{Wo)  >  —00  and  thus  val  (Wq)  is  finite.  Otherwise,  suppose  that  u  is  unbounded  from  below 
at  the  origin  on  a  set  A  of  t.  Let 


k  =  E 


L 


B{t} 


dt 


By  (13),  k  is  finite.  Thus 


Wo . 


-00, 


c(0=-yl{,M}>0     v< 
is  a  feasible  consumption  plan.  Thus 

val{Wo)  >  I  u{Wo/k,t)dt> 

where  the  inequality  follows  from  Assumption  2.       I 

Note  that,  in  (11),  if  6  >  1,  then  u(c,  t)  <  \u{a,t)\l3i.  Thus  the  expected  utility  is  always  strictly 
less  than  +00. 

Now  our  remaining  task  is  to  give  conditions  under  which  val{Wo)  is  attained.  We  will  utilize 
Cox  and  Huang  (1990)  by  rewriting  (9)  as  follows: 


<Wo. 


(14) 
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In  (14),  both  the  objective  functional  of  the  maximization  program  and  the  space  of  feasible 
objects  are  defined  on  a  measurable  space  (fi  x  ^+,VM)  with  a  finite  measure  Va-  This  fits  into 
the  framework  of  Cox  and  Huang  (1990). 

Here  is  our  first  existence  theorem: 

Theorem  1    Under  the  conditions  of  Proposition  4,  there  exists  a  solution  to  (l^). 

Proof.     The  assertion  follows  from  Cox  and  Huang  (1990,  theorem  4.1)  by  noting  that  Q  and  P 
are  locally  equivalent.      I 

The  next  theorem  is  for  the  case  where  the  utility  function  is  bounded  from  above  by  a  multiple 
of  |u(a,f)|. 

Theorem  2   Suppose  that 

1.  u{c,t)  <  K\u{a,t)\  for  a.e.  t; 
2. 

{ilB)-Ma,t)\eL^{u,Y  (15) 

3.  and  (13)  holds  when  u{c,t)  is  unbounded  from  below  at  the  origin  on  a  set  A  oft  with  strictly 
positive  Lebesgue  measure. 

Then  there  exists  a  solution  to  (14)- 

Proof.     By  the  first  hypothesis,  we  know  that 

-—. <  A     Vc,  a.e.  t. 

\uia,t)\  - 

Given  (13)  and  (15),  the  assertion  follows  from  a  (trivial)  generalization  of  Cox  and  Huang  (1990, 
theorem  4.2)  by  noting  that  P  and  Q  are  locally  equivalent.       I 

Before  leaving  this  section,  we  give  in  the  following  two  corollaries  sets  of  explicit  conditions  on 
the  parameters  of  prices  for  (12),  (13),  and  (15)  to  be  valid. 

Corollary  2  Suppose  that  there  exists  0  <  f  <  oo  so  that  0  <  r{t)  <  f,  P-a.s.  for  a.e.  t  and  there 
exists  T  >  0,  e  >  0  such  that 

-!2^>^A-'  +  ^i'  +  <    V,>T.  (16) 

t  26  0  +  p 

Then  (12)  is  valid.   When  (16)  holds  with  6=1,  (15)  is  valid. 
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Proof.     Note  that 
E 

=    E 


Given  that 


B{t) 


a   P  martingale 


exp  I  -^  J^  K{s)^dw{s)  -  ^  j['  \K{s)\'ds 


xexp^:^  (^-\-l]Kh  +  ^f\{s)d. 


26  \b 


5+  (  1  +  ^  )ln|u(a,0 


<-  MiiM'^-^i'^^^iy^^)'}- 


t  26  b  +  p 


v<  >  r, 


Fubini  theorem  then  implies  that  (12)  is  valid. 

Identical  arguments  proves  the  second  assertion  when  6=1. 


Corollary  3  Suppose  that  the  set  A  of  (13)  is  of  finite  Lebesgue  m<^usure.    Then  if  r{t)  >  0,  (13) 
is  always  valid.  Otherwise,  if  there  exists  0  <  r  so  that  r  <  r{t)  P-a.s.  for  a.e.  t,  then  (13)  is  valid. 

Proof.     Suppose  first  that  A  is  of  finite  Lebesgue  measure.  We  note  that  ,f  is  a  martingale  under 
P  with  unity  expectation.  Since  B{t)  >  1, 

at) 


B{t] 


<  1. 


Fubini  theorem  implies  that  (13)  is  valid. 

Next  suppose  that  A  is  of  infinite  measure.  The  hypothesis  of  this  corollary  yields 

Fubini  theorem  again  implies  that  (13)  is  valid.      I 

When  the  utility  function  is  not  unbounded  from  below,  for  existence,  it  suffices  that  the 
interest  rate  does  not  go  unbounded  and  the  utility  function  significantly  discounts  the  future 
cLsymptotically.  Otherwise,  the  agent  may  find  it  advantageous  to  keep  accumulating  his  wealth 
and  postpone  consumption  until  t  =  oo.  When  the  utility  function  is  unbounded  from  below  at  the 
origin,  we  will  further  require  that  the  interest  rate  does  not  become  too  low  so  that  it  may  become 
infeasible  to  mciintajn  a  certain  level  of  minimum  consumption  over  time  and  thus  the  expected 
utility  may  become  — oo. 
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4     Computation  of  Optimal  Policies 

This  section  is  devoted  to  the  computation  of  optimal  policies.  The  idea  follows  that  of  Cox  and 
Huang  (1989)  and  thus  we  will  be  brief.  The  main  result  reported  here  is  a  verification  theorem 
of  optimal  policies.  We  will  show  that  if  there  exists  a  solution  to  a  second  order  linear  parabolic 
partial  differentiaJ  equation  and  if  the  solution  satisfies  certain  conditions,  then  the  optimal  trading 
strategy  in  the  form  of  feedback  controls  can  be  computed  by  taking  derivatives  of  the  solution. 

For  the  purpose  of  this  section,  we  will  assume  that  u{c,t)  is  strictly  concave  in  c.  Then  define 
the  inverse  of  the  marginal  utility  function  f{x~^,t)  =  inf{c  G  K+  :  Uc+(c, 0  <  x~^},  where  Uc-y 
denotes  the  right-hand  partial  derivative  of  u  with  respect  to  c.  By  the  strict  concavity  of  !/(c,<) 
in  c,  it  is  easily  seen  that  /(x~',<)  is  continuous  in  x. 

We  assume  throughout  this  section  that  /  satisfies  a  growth  condition: 

f{x~^,t)  <  Kf\u{a,t)\i>xb      for  some  strictly  positive  constants  Kj,  b, 

and  (12)  holds  if  6  G  (0, 1)  and  (15)  holds  if  6  >  1.  Moreover,  if  u  is  unbounded  from  below  at  the 
origin,  (13)  holds.  Under  these  conditions,  it  is  easily  verified  that  conditions  of  either  Theorem  1 
or  Theorem  2  hold  and  there  exists  a  solution  to  (14). 

The  object  of  computation  here  is  the  value  over  time  of  future  optimal  consumption.  From 
(10)  we  know  this  value  in  units  of  the  bond  is 

cis) 


W{t)  =  E' 


i: 


■ds\J^t 


B(s) 

if  c  is  the  optimal  consumption.  Thus  F(t)  =  \V{t)B{t)  is  the  present  value  of  future  optimal 
consumption.  Under  some  conditions,  F  can  be  computed  by  solving  a  partial  differentia!  equation 
and  optimal  trading  strategies  are  related  to  the  derivatives  of  F. 

Before  proceeding,  we  record  in  the  following  proposition  the  first  order  condition  for  optimality, 
which  is  the  corner  stone  for  the  construction  of  an  optimal  policy. 

Proposition  5  Under  conditions  of  this  section,  there  exists  a  solution  to  (14)  if  and  only  if  there 
exists  a  X  >  0  so  that 

c(0  =  /(|^,<)ei;(.^J  (17) 


and 

c{t)at) 


f 

JO 


dt 


W' 


0- 


B{t) 

Proof.     The  only  if  part  follows  from  Saddle-Point  theorem  and  Rockafellar  (1975).  The  if  part 
follows  from  the  definition  of  /  and  the  concavity  of  u  in  c.       I 
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For  the  purpose  of  computation,  we  specialize  our  model  of  securities  prices  as  follows.  Assume 
that  S  satisfies  the  stochastic  integral  equation: 

S{t)  =  S{0)+  f  {biS{s),s)-diSis),s))ds+   f'a{Sis),s)dwis),      t>0,  (18) 

^0  Jo 

where  d{S{t),t)  is  the  A''-vector  dividend  rate  at  time  t  when  the  risky  asset  prices  are  S{t).  Assume 
further  that  r{t)  can  be  written  as  r{S{t),t).  Thus  «(<)  can  also  be  written  as  K{S{t),t). 
Next  define  a  process 

Z{t)  =  Z{0)+  f  {riSis),s)  +  \K{S{s),s)\^)Z{s)ds  -   f  K[S{s},sf  Z{s}duis),  (19) 

^0  Jo 

for  some  constant  Z{0)  >  0.  Using  Ito's  lemma,  it  is  easily  verified  that 

^,  ,       Z(O)Bit) 

As  pointed  out  by  Cox  and  Huang  (1989),  (logZ(r)  -  logZ(0))/r  is  the  realized  continuously 
compounded  growth  rate  from  time  0  to  time  T  of  the  growth-optimal  portfolio  -  the  portfolio 
that  majcimizes  the  expected  continuously  compounded  growth  rate. 
Now  write  (18)  and  (19)  compactly  together  under  Q: 

(  z[\]  )  =  (  Z(0)  ]+  J^aS{s),Zis),s)ds  +  J^d(S{s),Z(s),s}dw'is},  (21) 

where  we  note  that 


.(5(o,.(o.o  -  ( .if<;>f^;;',;i, ) 


Assume  throughout  this  section  that  ^  and  a  satisfy  a  local  Lipschitz  and  a  uniform  linear  growth 
condition  on  any  finite  time  interval  [0,r].'°  Thus  there  exists  a  unique  solution  to  (21)  and  (5,  Z) 
has  the  strong  Markov  property  under  Q  and  thus  is  a  diffusion  process  under  Q. 


The  functions  f  and  &  satisfy  a  local  Lipschitz  condition  on  every  [0,7^  with  T  <  oo  if  for  every  T  >  0  and 
M  >  0,  there  is  a  strictly  positive  constant  Kj^  such  that  for  all  y,  z  £  3?'^  x  (0,  oo)  with  \y\  <  M  and  \z\  <  M  and 

aii<e[o,r] 

IC(»,  t)  -  C{z,  01  <K^\y-  z\,       !*(!/,  t)  -  cr{z,  01  <  K^'\y  -  ^1- 

These  functions  satisfy  a  uniform  growth  condition  on  every  [0,T]  with  T  <  oo  if  for  every  T  >  0,  there  exists  a 
strictly  positive  constant  A'r  such  that,  for  all  i  6  3?''  x  (0,  oo)  and  t  g  [0,7^, 

|C(i,OI  <  Kt{1  +  \z\),         |*(i,OI  <  A'r(l  +  |x|). 
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The  following  notation  will  be  utilized: 

am  Qmi+m2  +  ...,mf/ 


D?  = 


m  =  mj  +  . . .  +  m;v 


for  positive  integers  mi,m2, . . .  ,m;v-  If  9  '•  ^'"^  X  [0,7]  •—  i?  has  partial  derivatives  with  respect  to 
its  first  jV  arguments,  the  vector  {dg/dyi,. . .  ,dg/dy\)^  is  denoted  by  Dyg  or  g^. 
Here  is  the  main  theorem  of  this  section: 

Theorem  3  Suppose  that 

1.  there  exists  a  Junction  F  :  (0,oo)  x  J?'^  x  [0,oo)  — ►  J?^.  such  that  DF^{y,t)  and  Fi(y,t)  are 
continuous  for  m  <  2,  F  is  a  solution  to  the  partial  differential  equation 

CF(Z,S,t)  -  r{S,t)F{Z,S,t)  +  FtiZ,S,t)  +  f{Z-\t)  =  0 

with  the  boundary  condition 

rF(7(T).S(T).TU 


lim  £■' 

t— oo 


FiZ{T),S(T).T)] 


B(T} 


where  C  is  the  differential  generator  of  {Z,S)  under  Q;^^  and,  for  all  T  >  0,  F  satisfies  a 
uniform  growth  condition  on  every  [0,T]  with  T  <  oc,  that  is,  there  exists  a  strictly  positive 
constants  KJ  and  -{^  so  that,  for  all  t  £  [0,T],  a 

\F{yJ)\  <  Af  (1  +  \yr^)     Vj/  £  (0,oo)  x  3^^; 

2.  and  there  exists  Zq  such  that  F{Zo,S{0),0)  =  Wq. 

Then  the  optimal  consumption  and  portfolio  policies  are 

c(0     =  f(Z{t)-\t)     u^-a.e. 

e{t)    ^[Fs{Z{t),S{t),t)  +  [a{S{t),t)a{S[t),tf]-' 

x[b{S{t),t)-r{S{t),t)S{t)]Z{t)Fz{Z{t),S{t),t)\      u,-a.e.  ^^^^ 

q(0     =[F{Z{t),S{t),t)-9{tyS{t)\lB{t)     z/, -a.e., 
where  we  have  put  Z(0)  =  Zq. 

Proof.     Using  the  growth  condition  on  /  and  F  and  the  fact  that  F  satisfies  the  partial  differential 
equation,  Cox  and  Huang  (1989,  Theorem  2.3)  implies  that,  for  every  t, 


F{Z{t),Sit),t) 
B{t) 


J. 


T  f{Z{s)-\s)  _,    ,   F(Z{r),5(r),T) 


B{s] 


■ds  + 


B[T) 


Tt 


^'LF  =  \it(Fss<rv'^)  +  \FzzZ^\k\^  +  Fszax.  +  Fs{rS  -  /)  +  FzrZ. 
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Let  T  —*  oo  and  use  the  boundary  condition  we  get 


F[Z{t),S(t)J) 
B{t) 


^E' 


j: 


J{Z{s)-\s) 
B{s) 


ds\Tt 


where  we  have  used  monotone  convergence  theorem.  Thus  F  gives  the  value  of /(Z   \<)  over  time. 
By  the  hypothesis,  Z(0)  =  Zq,  thus 


Wc, 


f(Z(0),5(0),0) 
B(0) 


E' 


f 

Jo 


f{Z{t)-\t) 
B{t) 


dt 


This  shows  that  c(t)  =  f{Z{t)~^,t)  exhausts  the  initial  wealth.  If  we  can  show  that  c  €  L^{i/a), 
then  by  Proposition  5,  c  is  a  solution  to  (14).  By  the  growth  condition  on  /,  (12),  and  (15),  one 
quickly  verifies  that  c  G  L^ii^a)  and  thus  is  a  solution  (14).  The  fact  that  the  trading  strategy 
that  finances  c  is  as  described  in  (22)  follows  from  identical  arguments  on  Cox  and  Huang  (1989, 
theorem  2.2).      I 


5    A  Special  Case 

We  now  specialize  the  market  model  developed  in  the  earlier  sections  and  consider  the  model  with 
constant  coefficients  examined  by  Merton  (1971)  and  revisited  recently  by  Karatzas,  Lehoczky,  and 
Shreve  (1987).  In  this  case  explicit  formulas  for  the  optimal  consumption  and  portfolio  policies 
can  be  computed  just  as  in  Cox  and  Huang  (1990).  The  method  does  not  use  stochastic  control 
and  takes  care  in  a  natural  way  of  the  non  negative  constaint  on  consumption.  We  illustrate  our 
results  with  two  examples  taken  from  the  family  of  constant  absolute  risk  aversion  and  HARA 
utility  functions. 

We  shall  use  the  following  specialization.    The  risky  securities  follow  a  geometric  Brownian 
motion 

Sit)  =  5(0)  +  J  (/s(,)b  -  d{Sis),s)) ds  +  J  Is(,)ffdw{s),     t  >  0 

where  b  is  an  n- vector  of  constants,  <t  an  n  x  n  non-singular  matrix  of  constants  and  /5(()  an  n  x  n 
diagonal  matrix  having  S'{t)  in  the  (i,i)th  position.  We  furthermore  assume  that  r  is  constant  and 
write  r  for  an  n- vector  of  r's  and  k  for  the  constant  vector  —a~^{h  —  r). 
Given  some  initial  data  z,  define  (f)  as 

■    roo  "I 

<f>{z)  =  E'     /     e-''f{Z{tr\t)dt   ;      Z-'(O)  -  ^. 
Jo 

Assuming  u(c,t)  =  v{c)e~^'  (cf.  remark  2),  we  can  write  alternatively 


<i>iz)  =  E' 


/     e-^^g(e'^'Zitr) 
Jo 


dt 


Z-\0)  =  z, 
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where  g  is  the  inverse  of  the  time-independent  marginal  utility  function  Vc^{c). 
Since  it  is  easily  verified  that 

e^'Z{t)-'^  =  zexp{K^u--(0  +  (f3-  r  +  |«|V2)0, 

one  sees  that  the  function  F  of  section  4  can  be  identified  as  F{z,t)  =  4>{e^'z~^).  Under  Q, 
e^'Z(<)~^  is  lognormally  distributed  with  mean  logz  -|-  (/3  -  r  +  £>^/2)t  and  variance  g'^t,  where  o  is 
the  square  root  of  \k\^.  It  follows  that 

x  -\ogz  -{3  -  r  +  0^/2)^ 


Jo     J-oo  gvt  \ 


eVt 


dt  dx. 


where  n  stands  for  the  standard  normal  density  function.  This  yields 

4>{z)     =      /       ^-^^-!-  /    4=e  '^'  dtdx 

J-oo       g     Jo    y/2^t 

■OO    gy/2'K  Jo 

where  we  have  put  0  =  P  -  r  +  g'^/2  and  q^  =  2r  -(-  3^/g'^, 


r+oo 
Joo 


2ff(e") 
£>y27r' 


-'°8') 


logz 


^a 


A'l 

2 


X  -logz 


^Q" 


dx. 


where  A'1/2  is  associated  with  a  Bessel  function  and  takes  here  the  particular  form  A'i/2(^)  = 
^^  e~^;  cf.  Gradshteyn  and  Ryzhik  (1979,  pp.  340  and  967).  We  then  evaluate  the  last  integral 
to  obtain  the  formula: 


4>iz)  = 


ga 


Jo  Jo 


where 


/i     = 


g^       g 


g^       g 

are  both  positive.  Using  the  formula  above,  it  is  then  easy  to  compute  <p  for  a  wide  range  of  utility 
functions.  Note  that  when  utility  has  a  finite  marginal  utility  at  zero,  optimal  consumption  may 
involve  zero  consumption.  Indeed,  C(  =  0  if  and  only  if  fc+(0)  <  e^'Z(<)~^  that  is  if  and  only  if 
nominal  wealth  e''^W{t)  is  less  than  the  deterministic  time-independent  boundary  given  by 

W  =  4>{vM0))  =—  r  [5(vc+(0)e-")e-'^"  +  5(vc+(0)e")e-'^'"]  du. 
get  Jo     ^  J 

We  now  give  two  examples. 
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Example  1    Utility  functions  of  constant  absolute  risk  aversion. 
Let  the  time-independent  utility  function  be 

where  ^  >  0  is  the  coefficient  of  absolute  risk  aversion.  In  this  case,  we  find 


1 


-^logx 


5(x)  = 

-il/e){\ogz-u)     if  u>  log  2, 


and  so 

^^''  \   0  otherwise, 

and  similarly  for  g{z€^).  Straightforward  computations  show  that  if  z  >  1 


<^(.)  = 


r(2,^iog2) 


log. 


and  that  if  z  <  1 


4>iz)  = 


Qady?  "    gaOn^ 

1  logz        log  2    /  ,\       7(2, /i' log  2-^ 


Qadfj?       gaOfj,       qo.Ojj, 
where  7  and  F  are  the  incomplete  gamma  functions 

7 


^  ('-"■) 


gaOy. 


,2 


(a,i)     =      r  e-H"-^  dt 
Jo 

/•CO 

T{a,x)    =      /     e-h"-^  dt. 


It  is  easily  checked  that  F  is  twice  continuous  and  that  F  — ►  0  as  2  — >  00  and  F 
The  vector  of  optimal  dollar  amounts  invested  in  the  stocks  is  given  by 


00  as  2  — ►  0. 


At  =  ls(i)0{t)  =  -^^Z{tr{aa'^){h  -  r) 


if  Z{t)  <  e^'  and  by 


if  Z{t)  >  e^'. 


At 


1 


+ 


1 


„/3m'( 


.gadfj,      ga9n 


-{l-e^'^'Zity) 


((7a^)(b-r) 


Example  2  HARA  utility  functions. 
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Let  V  be  in  turn 

with  /)>0,  T/>0,  7<1  and  7  7^  0.    In  the  first  condition  of  proposition  4  it  suffices  to  take 
b  =  I  -  1  when  7  >  0.  In  this  case  one  finds 

■  + 
-  f?      • 


S(x)='-^ 


p 


^X       1/1-7 


Computations  whose  length  is  the  sole  difficulty  give 

gQfi{n-  1/1  -7)/)  \pj 
/hen  z  >  />r/-(i-"')  =  Uc+(0)  and 


^(5     \pJ  pr  QQfi'ifi'  +  1/1-1)  p  \p 

when  2  <  Uc+(0),  where 


1-7  V  2(1-7)7- 

The  inequalities  6  >  0,  p.  >  1/(1-7)  and  /z'  >  -1/(1  -  7)  all  result  from  0  >  -jr  +  (7/I  -  7)0^2 
which  itself  follows  from  condition  16  of  corollary  2. 

The  case  r?  =  0  is  the  one  that  is  usually  taken  in  the  approach  of  dynamic  programming,  for 
this  is  the  one  for  which  the  Bellman  equation  can  be  solved  quite  explicitly.  This  yields  the  simpler 
expression 

<P(z)  ^ 


p6     VP/ 

from  which  one  derives  Cj  =  SWtC^K  It  is  clear  that  except  in  the  degenerate  case  7;  =  0  the  optimal 
consumption  and  portfolio  policies  are  not  linear  functions  of  wealth,  because  of  the  non  negativity 
constraint  on  consumption.  When  z  >  Vc+{0),  we  have  z(p'{z)  =  —p4>{z).  Hence  when  nominal 
wealth  e^^Wt  falls  below  the  non-stochastic  boundary  W_,  consumption  is  zero  and  the  optimal 
dollar  investment  in  the  stocks  is  proportional  to  wealth  with 

At  =  ^le'^Wt{aa^y\h-T). 

When  z  <  Uc+(0),  i.e.,  when  nominal  wealth  is  above  W_,  the  optimal  policy  is  no  longer  linear.  As 
z  approaches  zero,  however,  which  corresponds  to  large  values  of  wealth,  the  optimal  consumption 
and  investment  policies  are  "almost"  the  linear  functions  of  wealth  given  in  Merton  (1971). 
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6     Convergence  of  Finite  Horizon  to  Infinite  Horizon  Solutions 

We  study  two  convergence  problems  in  this  section.  First  we  show  that  the  optimal  consumption 
policy  in  an  infinite  horizon  economy,  if  one  indeed  exists,  is  a  pointwise  limit  of  those  in  corre- 
sponding finite  horizon  economies.  Second,  in  general,  the  optimal  portfolio  policy  in  an  infinite 
horizon  economy  may  not  be  the  pointwise  limit  of  those  in  finite  horizon  economies.  Under  some 
conditions,  however,  if  the  pointwise  limit  of  the  finite  horizon  optimal  portfolio  policies  exists,  it 
must  be  the  optimal  portfolio  policy  for  the  infinite  horizon  economy. 

The  convergence  results  reported  here  are  useful  in  two  aspects.  First,  for  the  class  of  models 
where  closed-form  solutions  exist  for  finite  horizon  economies,  we  know  conditions  under  which  the 
optimal  policy  in  infinite  horizon  can  be  gotten  by  letting  T  — >■  oo  in  the  finite  horizon  policies. 
Second,  in  the  numerical  computation  of  the  optimal  policy  for  the  infinite  horizon  problem,  the 
horizon  will  have  to  be  truncated.  It  is  therefore  imperative  to  know  conditions  under  which  the 
solutions  to  finite  horizon  problems  are  approximations  to  that  to  an  infinite  horizon  problem. 

Assume  untU  further  notice  that  conditions  of  Theorem  1  or  Theorem  2  hold  and  thus  there 
exists  a  solution  to  (14),  denoted  by  c*.  Also  assume  that  the  utility  function  is  strictly  concave  in 
consumption  and  thus  the  optimal  consumption  plan  is  unique.  Consider  a  class  of  finite  horizon 
problems: 

s"PceLP,K;T)     Elir^Si^^M  (23) 

where  we  have  used  L^{i>a\T)  to  denote  the  positive  orthant  of  the  space  of  progressive  processes  c 

such  that 

l-T 

<  oo. 


/    \c{tWdX,{t) 
Jo 


It  is  clear  that  under  conditions  of  Theorem  1  or  Theorem  2,  there  exists  a  unique  optimal 
consumption  policy  of  (23),  denoted  by  c^.  The  following  theorem  shows  that  c^  —>  c',  Ua  -  a.e., 
as  T  — ►  oo.  Thus,  if  we  know  the  functional  expression  of  c^ ,  which  naturally  depends  on  T,  we 
will  get  the  optimal  consumption  policy  for  the  infinite  horizon  case  by  simply  letting  T  —  oc. 

We  first  record  a  lemma. 

Lemma  5  Let  Xt  be  such  that  J{t)  =  f{^^^,t)  v^-a-e.   Then  X^  >  Xj  if  T'  >  T. 

Proof.     Suppose  otherwise  that  Aj-  <  Aj.  By  the  strict  concavity  of  u  in  c,  we  know  that  /  is 
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strictly  decreasing  when  it  is  nonzero.  This  implies  that 


V^o 


<     E 


h  Bit) 

Jo 


dt 


<  E 


Jo 


fi(') 

Bit) 


Bit) 


dt 


We  claim  that  one  of  the  first  inequality  in  the  above  relation  must  be  a  strict  inequality  and  hence 
c^'  violates  the  budget  constraint  for  the  finite  horizon  problem  with  horizon  [0,r']  and  constitutes 
a  violation.  Now  suppose  that 


i 


^mf{^,t) 


Bit) 


dt 


Jo 


Bit) 


This  necessitates  that  on  [0,T],  c    =  0  j^a-a.e.  This  clearly  contradicts  the  fact  that  c    is  an  optimal 
solution  to  (23).      I 

Now  let  A*  be  such  that  c'H)  =  /(^^,0>  fa-a.e. 
Theorem  4  limT-^oo  -^T  =  ^'  o^d  c    — ►  c',  i/o-a.e. 

Proof.     Once  we  can  show  that  Aj  -+  A'  as  T  — ►  oo,  the  second  assertion  follows  from  the  fact 
that  /  is  continuous  in  its  first  argument  by  the  strict  concavity  of  u  in  c. 
By  Lemma  5,  there  exists  a  limit 

A  =   lim  At. 

r-oo 

We  claim  that  A  =  A'. 

We  take  two  cases.  Suppose  first  that  A  >  A'.   Then  there  exists  T  <  oo  such  that  Xj  >  A'. 
Arguments  identical  to  those  used  in  the  proof  of  Lemma  5  prove  that 


H'o  <  E 


I 


-^(0/(^,0 


Bit) 


dt 


which  is  a  contradiction. 

Next  suppose  that  A  <  A*.  Pick  A  G  (A,  A*).  Arguments  identical  to  those  used  in  the  proof  of 
Lemma  5  show  that 


Wo  =  E 


I 


him 


Tat)fi^j) 

Bit) 


dt 


>  E 


km 


Jo 


Bit) 


dt 


,    vr  >  0. 
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Letting  T  — ►  oo  on  the  right-hand  side  of  the  second  inequality  gives 


Wo>E 


I 


-e(0/(^,0 


B{t) 


dt 


>  E 


I 


hliill 


B{t) 


dt 


=  W. 


If  the  second  inequality  above  is  an  equality,  then  it  must  be  that  c'  =  0  i^a-a-.e.,  which  is  clearly 
suboptimaJ.  Thus  the  inequality  must  be  a  strict  inequality  and  it  leads  to  a  contradiction. 


Next  we  turn  our  attention  to  the  convergence  of  trading  strategies.   For  this  we  restrict  our 
attention  to  the  case  where  p  >  2  and  make  the  following  assumption: 


Assumption  3        l.Ifu  satisfies  conditions  of  Theorem  1,  then 
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2.  If  u  satisfies  conditions  of  Theorem  2,  then 
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We  record  below  a  useful  technical  lemma. 
Lemma  6  Let  c  be  the  solution  to  (I4)  financed  by  (a, 6)  G  C{G).   Then,  under  Assumption  3, 
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dt 


<  00. 


Proof.     Using  the  fact  that  P  and  Q  are  locally  equivalent,  the  first  assertion  follows  from  similar 
arguments  of  Cox  and  Huang  (1990,  theorem  4.1). 
Form  the  proof  of  Proposition  3,  we  know  that 
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The  left-hand  side  is  a  square-integrable  martingale  under  Q.  Thus  Jacod  (1979,  2.48)  shows  that 
the  second  assertion  of  this  lemma  is  valid.       I 

Now  we  present  our  results  of  convergence  of  trading  strategies.  In  general,  we  do  not  have 
almost  everywhere  convergence  of  trading  strategies  as  for  consumption  policies.  Rather,  we  will 
have  convergence  in  a  metric  involving  taking  expectation  under  Q. 
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Theorem  5   Let  {a,  6)  and  (07,^7)  be  the  trading  strategies  that  finance  c'  and  c^ ,  respectively. 
Then 
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dt 


=  0. 


Proof.     Note  first  that  c^(0  =  /(^^,01{(<T}  <  >  0  and  c'{t)  =  fi^^j)  t  >  0.    Triangle 
inequality  implies 
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Recall  from  Lemma  5  that  A7  is  an  increjising  function  of  T  and  from  Theorem  4  that  A"   = 
lim7_oo  -^r-  Thus  both 
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decrezise  to  zero  fa-a.e.  Lebesgue  convergence  theorem  yields  that 
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0. 


The  assertion  then  follows  from  the  fact  that 
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Theorem  5  is  not  enough  for  us  to  conclude  that  the  optimal  trading  strategy  for  the  infinite 
horizon  case  can  be  gotten  by  letting  T  — ►  00  in  the  optimal  strategies  for  the  finite  horizon  cases  as 
we  need  almost  everywhere  convergence  for  this.  The  following  theorem  gives  a  sufficient  condition 
for  this  operation  to  be  valid. 

Theorem  6   Let  {a,B)  and  {oiti^t)  ^  ^^^  trading  strategies  that  finance  c'  and  c^ ,  respectively. 
Suppose  that  lim7_oo^r(0  exists  Va-a.e.,  then  limT-^oc^Ti^)  —  ^(0  t/a-a.e. 


7     Concluding  Remarks  27 

Proof.  First  recall  that  Ot  ^  0  m  the  sense  of  Theorem  5.  Chung  (1974,  theorems  4.1.4  and 
4.2.3)  implies  that  there  exists  a  subsequence  {Tn}  with  r„  t  oo  so  that  dT„  — ►  0,  i/o-a.e.  as  n  — »  oo. 
Given  the  hypothesis  that  limr— oo  ^t(0  exists  i/a-a.-e.,  it  follows  that  limj_oo  ^t(0  =  ^(i),  i^a-a.e. 
I 

In  words,  if  the  optimal  portfoho  policies  for  finite  horizon  economies  do  converge  pointwise, 
they  must  then  converge  to  the  optimal  policy  for  the  infinite  horizon  economy.  For  example,  the 
reader  can  verify  that  under  Assumption  3  the  optimal  portfolio  policy  for  the  HARA  class 

utility  function  cis  reported  in  Cox  and  Huang  (1989)  converges  pointwise  and  thus  the  limit  is  the 
optimal  policy  for  the  infinite  horizon  case.  This  is  consistent  with  our  result  in  Section  5. 

7  Concluding  Remarks 

We  have  assumed  throughout  this  paper  that  there  are  as  many  linearly  independent  risky  securities 
as  the  dimension  of  the  underlying  uncertainty,  or,  markets  are  dynamically  complete.  When 
markets  are  dynamically  incomplete,  it  is  straightforward  to  borrow  from  He  and  Pearson  (1989) 
and  show  that  when  prices  of  securities  together  with  some  other  processes  follow  a  diffusion  process, 
then  the  optimal  policy  can  be  computed  by  solving  a  quasi-linear  partial  differential  equation. 
Since  He  and  Pearson  (1989)  only  provided  existence  theorems  for  the  case  where  the  individual 
has  preferences  only  over  final  wealth  and  not  on  intermediate  consumption,  the  existence  question 
in  the  infinite  horizon  case  when  markets  are  dynamically  incomplete  is  still  open. 
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